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We derive rigorous results on the link between the principle of maximum entropy production 
and the principle of maximum Kolmogorov- Sinai entropy for a Markov model of the passive scalar 
diffusion called the Zero Range Process. We show analytically that both the entropy production and 
the Kolmogorov-Sinai entropy, seen as functions of a parameter / connected to the jump probability, 
admit a unique maximum denoted fmax EP and f ma x KS - The behavior of these two maxima is 
explored as a function of the system disequilibrium and the system resolution N. The main result 
of this article is that /„ JSP and f m ax KS have the same Taylor expansion at first order in the 
deviation from equilibrium. We hnd that fmax EP hardly depends on N whereas fmax KS depends 
strongly on N. In particular, for a fixed difference of potential between the reservoirs, fmax EP (N) 
tends towards a non-zero value, while fmax KS (N) tends to 0 when N goes to infinity. For values 
of N typical of those adopted by Paltridge and climatologists working on MEP (TV ss 10 ~ 100), 
we show that f m ax EP and f maXKS coincide even far from equilibrium. Finally, we show that one 
can find an optimal resolution IV* such that fmax EP and fmax KS coincide, at least up to a second 
order parameter proportional to the non-equilibrium fluxes imposed to the boundaries. We find 
that the optimal resolution N* depends on the non equilibrium fluxes, so that deeper convection 
should be represented on finer grids. This result points to the inadequacy of using a single grid for 
representing convection in climate and weather models. Moreover, the application of this principle 
to passive scalar transport parametrization is therefore expected to provide both the value of the 
optimal flux, and of the optimal number of degrees of freedom (resolution) to describe the system. 
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I. INTRODUCTION 

A major difficulty in the modeling of nonlinear geophysical or astrophysical processes is the taking into account of all 
the relevant degrees of freedom. For example, fluid motions obeying Navier-Stokes equations usually require of the 
order of N = Re 9 / 4 modes to faithfully describe all scales between the injection scale and the dissipative scale (?). 
In atmosphere, or ocean, where the Reynolds number exceeds 10 9 , this amount to IV = 10 2 °, a number too large to 
be handled by any existing computers (?). The problem is even more vivid in complex systems such as planetary 
climate, where the coupling of lito-bio-cryo-sphere with ocean and atmosphere increases the number of degrees of 
freedom beyond any practical figure. This justifies the long historical tradition of parametrization and statistical 
model reduction, to map the exact equations describing the system onto a set of simpler equations involving few 
degrees of freedom. The price to pay is the introduction of free parameters, describing the action of discarded degrees 
of freedom, that needs to be prescribed. 

When the number of free parameters is small, their prescription can be successfully done empirically through cali¬ 
brating experiments or by a posteriori tuning (?). When the number of parameters is large, such as in climate models 
where it reaches several hundreds (?), such empirical procedure is inapplicable, because it is impossible to explore the 
whole parameter space. In that respect, it is of great interest to explore an alternative road to parametrization via 
application of a statistical optimization principle, such as minimizing or maximizing of a suitable cost functional. As 
discussed by (?) and (?), this strategy usually leads to closed reduced equations with adjustable parameters in the 
closure appearing as weights in the cost functional and can be computed explicitly. A famous example in climate is 
given by a principle of maximum entropy production (MEP) that allowed (?) to derive the distribution of heat and 
clouds at the Earth surface with reasonable accuracy, without any parameters and with a model of a dozen of degrees 
of freedom (boxes). Since then, refinements of Paltrige model have been suggested to increase its generality and range 
of prediction (?). MEP states that a stationary nonequilibrium system chooses its final state in order to maximize 
the entropy production as is explain in (?). Rigorous justifications of its application have been searched using e.g. 
information theory (?) without convincing success. More recently, we have used the analogy of the climate box model 
of Paltridge with the asymmetric exclusion Markov process (ASEP) to establish numerically a link between the MEP 
and the principle of maximum Kolmogorov- Sinai entropy (MKS)(?). The MKS principle is a relatively new concept 
which extends the classical results of equilibrium physics (?). This principle applied to Markov Chains provides 
an approximation of the optimal diffusion coefficient in transport phenomena (?) or simulates random walk on ir¬ 
regular lattices (?). It is therefore a good candidate for a physically relevant cost functional in passive scalar modeling. 

The goal of the present paper is to derive rigorous results on the link between MEP and MKS using a Markov model 
of the passive scalar diffusion called the Zero Range Process (?). We find that there exists an optimal resolution A* 
such that both maxima coincide to second order in the distance from equilibrium. The application of this principle 
to passive scalar transport parametrization is therefore expected to provide both the value of the optimal flux, and of 
the optimal number of degrees of freedom (resolution) to describe the system. This suggests that the MEP and MKS 
principle may be unified when the Kolmogorov- Sinai entropy is defined on opportunely coarse grained partitions. 


II. FROM PASSIVE SCALAR EQUATION TO ZRP MODEL 


The equation describing the transport of a passive scalar like temperature in a given velocity field u(x, t) reads: 


d t T + ud x T = k8 2 x T, 


(1) 


with appropriate boundary conditions, or equivalently, in non-dimensionnal form: 


d t T + ud x T 


RePr 


d 2 x T, 


( 2 ) 


where k, Re and Pr are respectively the molecular diffusivity, the Reynolds and the Prandtl number. To solve this 
equation, one must know both the velocity field and the boundary conditions, and use as many number of modes 
as necessary to describe all range of scales up to the scales at which molecular diffusivity takes place i.e. roughly 
(RePr) 3 / 2 modes, where Re is the Reynolds number of the convective flow, and Pr is its Prandtl number. In geo¬ 
physical flows, this number is too large to be handled even numerically (?). Moreover, in typical climate studies, the 
velocity flow is basically unknown as it must obey a complicated equation involving the influence of all the relevant 
climate components. In order to solve the equation, one must necessarily prescribe the heat flux / = —uT + kVT. 
The idea of Paltridge was then to discretize the passive scalar equation in boxes and prescribe the heat flux /j^+i) 
between boxes i and i+1 by maximizing the associated thermodynamic entropy production S = JA /,( i+i)(7UT“57)- 
Here, we slightly modify the Paltridge discretization approximation to make it amenable to rigorous mathematical 
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results on Markov Chains. For simplicity, we stick to a one dimensional case (corresponding to boxes varying only in 
latitude) and impose the boundary conditions through two reservoirs located at each end of the chain (mimicking the 
solar heat flux at pole and equator). We consider a set of N boxes that can contain an arbitrary number n £ N of 
particles. We then allow transfer of particles in between two adjacent boxes via decorrelated jumps (to the right or 
to the left) following a ID Markov dynamics governed by a coupling with the two reservoirs imposing a difference of 
chemical potential at the ends. The resulting process is called the Zero Range Process (?). The different jumps are 
described as follow. At each time step a particle can jump right with probability pw n or jump left with probability qw n 
where w n is a parameter depending of the number of particles inside the box. Physically it represents the interactions 
between particles. At the edges of the lattice the probability rules are different: At the left edge a particule can enter 
with probability a and exit with probability "fw n whereas at the right edge a particle can exit with probability (3w n 
and enter with probability S. Choices of different w n give radically different behaviors. For example w n = 1 + b/n 
where b > 0 described condensation phenomena (?) whereas w\ = w et w n = 1 if n > 2 has been used to modeled 
road traffic. We will consider in this article the particular case where w = 1 by convenience of calculation. Moreover 
without loss of generality we will take p > q which corresponds to a particle flow from the left to the right and note 
/ = p — q . After a sufficiently long time the system reaches a non-equilibrium steady state. The interest of this toy 
model is that it is simple enough so that exact computations are analytically tractable. 

Taking the continuous limit of this process, it may be checked that the fugacity z, which is a quantity related to the 
average particle density (see [ 9 ] below), of stationary solutions of a system consisting of boxes of size follows the 
continuous equation (?) : 


/ 


dz 

dx 


1 d 2 z 
2N~dxP 


= 0 , 


( 3 ) 


corresponding to a stationary solution of a non-dimensional passive scalar equation with non-dimensionnal velocity 
/ and a non-dimensionnal diffusivity R l Pr = Therefore, the fugacity of the Zero Range Process is a passive 
scalar obeying a convective-diffusion equation, with advection velocity controlled by the probability to jump to the 
right or to the left, and diffusivity controlled by the number of boxes: the larger the number of boxes (the finer the 
resolution) the smaller the diffusivity. This observation illuminates the well-known observation that the numerical 
diffusion of a discrete model of diffusion is inversely proportionnal to the resolution. The parameter / controls the 
regime: / = 0 corresponds to a purely conductive regime whereas the larger / the more convective the regime. In the 
sequel, we calculate the entropy production and the Kolmogorov-Sinai entropy function of /. These two quantities 
reach a maximum noted respectively fm.ax E p an d fmax KS - The MEP principle (resp. the MKS principle) states that 
the system will choose / = f maXEP (resp / = fmax KS )- 

We will show first of all in this article that numerically f maXEP ~ fma XKS even far from equilibrium for a number of 
boxes N roughly corresponding to the resolution taken by ? in his climate model. This result is similar to what we 
found for the ASEP model (?) and thus gives another example of a system in which the two principles are equivalent. 
Moreover we will see analytically that f m ax EP and fmax KS have the same behavior in first order in the difference of 
the chemical potentials between the two reservoirs for N large enough. These results provide a better understanding 
of the relationship between the MEP and the MKS principles. 


III. NOTATIONS AND USEFUL PRELIMINARY RESULTS 

This Markovian Process is a stochastic process with a infinite number of states in bijection with In fact, each 
state can be written n = (n 1 , 712 , • tiat) where nt is the number of particule lying in site i. We call P n the stationary 
probability to be in state n. In order to calculate this probability it is easier to use a quantum formalism than the 
Markovian formalism as explained in the following articles (??). 

The probability to find m particles in the site k is equal to: p k (nk = to) = where Z k is the analogue of the grand 
canonical repartition function and Zk is the fugacity between 0 and 1. Moreover Z k = X]°Xo z k = 1 -z k • So, finally 


p k {n k = to) = (1 - z k )z™, 


( 4 ) 


We can show that the probability P over the states is the tensorial product of the probability p k over the boxes: 


P = Pi ® P 2 < 8 > < 8 >Pat, 
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Thus events (jik = m) and ( n' k = m!) for k ^ k' are independent and so: 

P(mi,m 2 ,...,mjv) = Pi(ni = mf) * ... *p N {n N = m N ), (5) 

So finally 

N 

P(m 1 ,m 2 , ...,m N ) = JJ(1 - z k )z™ k . (6) 

k =1 

Moreover, with the Hamiltonian equation found from the quantum formalism we can find the exact values of Zk 
function of the system parameters: 


_ (f) fc 1 [(a +5)(p-q) - afi+ 1 $\ - 76 + 0/3(2)^ 1 

lip - 9 - P) + Pip ~ Q + l)( R q ) N ~ X 

and the flux of particles c: 


^ 5 + a ^R)N-l 

° P q i(p-q-P) + P(p-q + i)( R ) N ~ 1 ' 

Finally, the stationary density is related to the fugacity by the relation: 


Pk — %k 


d\ogZ k 

dz k 


Zk 

1 ~ z k ' 


(7) 


( 8 ) 


(9) 


A. Entropy Production 

For a system subject to internal forces Xi and associated fluxes Ji the macroscopic entropy production is well known 
(?) and takes the form: 


* = £ *x t . 

i 

The Physical meaning of this quantity is a measure of irreversibility: the larger a the more irreversible the system. 
In the case of the zero range process irreversibility is created by the fact that p ^ q. We will parametrize this 
irreversibility by the parameter / = p — q and we will take p + q = 1. In the remaining of the paper, we take, without 
loss of generality, p < q which corresponds to a flow from left to right. Moreover, the only flux to be considered is 
here the flux of particules c and the associated force is due to the gradient of the density of particules p : X = V log p 
(?)• 

Thus, when the stationary state is reached ie when c is constant: 


N—l 


<7 =Y1 c -( lo g (Pi) - lo s(Pi+i)) = c.(log(pi) - log{p N )). 

i =1 

Thus, according to Eqs. 0.0.0 and ([To]) when N tends to +oo we obtain: 


( 10 ) 


7(f) 


f+1 f+l~ 




( 11 ) 


Because / > 0 the entropy production is positive if and only if p\ > pn iff z± > Zn- This is physically coherent 
because fluxes are in the opposite direction of the gradient. We remark that if / = 0 then a(f ) = 0. Moreover, when 
/ increases pi(f) decreases and P 2 (f) increases till they take the same value. Thus it exists /, large enough, for which 
cr(f) = 0. Between these two values of / the entropy production has at least one maximum. 
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B. Kolmogorov-Sinai Entropy 

There are several ways to introduce the Kolmogorov-Sinai entropy which is a mathematical quantity introduced by 
Kolmogorov and developed by famous mathematician as Sinai and Billingsley (?). Nevertheless, for a Markov process 
we can give it a simple physical interpretation: the Kolmogorov-Sinai entropy is the time derivative of the Jaynes 
entropy (entropy over the path). 


Sjaynesit) = ~ ^ ^[0,*] ' lo g(Pr [0 , t] ), 

r [0,t] 


( 12 ) 


For a Markov Chain we have thus: 


^Jaynesij^) $Jaynesi,t 1 ) — t Pij\og(pij), (13) 

(*.J) 

where p s tat = Pi sta P = 1 ...N is the stationary measure and where the p t j are the transition probabilities. 

Thus the Kolmogorov-Sinai entropy takes the following form: 

has = VistatPij iog (Pij), (14) 

(*>j) 

For the Zero Range Process ,we show in appendix that it can be written as: 


h K s 


N 

— (a log a + 5 log J + 7 log 7 + /3 log /? + {N - l)(plog(p) + glog(g))) + (plog(p) + g log(g)) ^(1 

i—1 


+ (7l°g(7) +pl°g(p))(l - - 1 ) + (P l°g(/3) + glog(g))(l - z N ). 


Zi) 


(15) 


IV. RESULTS 


We will start first by pointing to some interesting properties of f m ax EP and fmax KS i then by presenting numerical 
experiments on the ZRP model and finally concluding with some analytical computations. 

Let us first note that for N,a,/ 3, 7 ,<5 fixed the entropy production as well as the Kolmogorov-Sinai entropy seen as 
functions of / admit both a unique maximum. When N tends to infinity and / = 0, using Eq.([7]) (i.e. the symmetric 
case), we find that z\ = — and zn = . Thus, the system is coupled with two reservoirs with respective chemical 

potential “(left) and | (right). For “ ^ | the system is out of equilibrium. We assume, without loss of generality, 
Z\ > Zjv which corresponds to a flow from left to right. As a measure of deviation from equilibrium we take s = Z\—Zj^'. 
the larger s, the more density fluxes we expect into the system. 

First we remark that f m ax E p hardly depends on N whereas f m ax K s depends strongly on N. This is easily understood 
because a depends only on z\ and zjy whereas hxs depends on all the Z{. Moreover, the profile of the Zi depends 
strongly on N. In particular, for a fixed difference of potential between the reservoirs , fmax EP {N) tends towards a 
non-zero value, while f m ax KS (N) tends to 0 when N goes to infinity. 

Moreover, f m ax EP and fmax KS coincide even far from equilibrium for N corresponding to the choice of ? N ss 10 ~ 100. 
For N fixed, as large as one wants, and for all e, as small as one wants, it exists v such that for all s £ [0; v] 
\fmax EP fmaxKS I — ^* 

These observations are confirmed by the results presented in Figures [T] and [3] where EP and KS are calculated using 
Eq. 0 and (15) for s = 0.13 and three different partitions: N = 20 N = 100 et N = 1000. The figure shows 
that fmax EP and f m ax ks coincide with good approximation for N = 20 and N = 100. But then when N increases 
fmaxKs(N) tends to 0 whereas fmax EP {N) tends to a non-zero value. 

In Figure [ 2 ] we represent the Entropy Production (top) and KS Entropy (bottom) function of / for N = 1000 and 
for three value of s: s = 0.13; s = 0.2; s = 0.04. This supports the claim that for N fixed, we could tried different 
values of s such that s £ [0;i>] \fmax EP ~ fmax KS \ < e - Figure [3 shows that A f max is minimum when the system is 
close to equilibrium whereas the further the system is from equilibrium (when s increases) the more Af max increases. 
Moreover the optimal resolution where f m ax EP and f m ax KS coincide is approximately 10 ~ 100. Then A f max is 
maximum at N = 500 and s = 0.05. A f max is obvously linear in s, for small values of s, but the behaviour with N 
is more complicated. 
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Such numerical investigations suggest to understand why f m ax KS {N) and f m ax B p (N) have different behaviors function 
of TV, and why for N large enough f m ax K s an d fmax BP have the same behavior of first order in the deviation from 
equilibrium measured by the parameter s. We will see that we can get a precise answer to such questions by doing 
calculations and introducing a sort of Hydrodynamics approximation. 


A. Taylor expansion 


From Eq. (15) it is apparent that /„ 


depends on N whereas from Eq. (10) we get that /, 


,p hardly depends 

on N. Indeed there is a difference between f maXEP and / maXArs , i.e. a difference between the two principles for the 
Zero Range Process. Nevertheless, we have seen numerically that there is a range of TV, namely N « 10 ~ 100 for 
which the maxima fairly coincide. 

Using Eqs. we compute analytically the Taylor expansion of f maXE p an( I fmax KS in s. We will show 

the main result: fmax BP and f m ax KS have the same Taylor expansion in first order in s for N large enough. Their 
Taylor expansions are different up to the second order in s but it exists an N, i.e. a resolution, such that f m ax BP and 
fmaxKs coincident up to the second order. 

Let us start by computing f ma x KS ■ It does not depend of the constant terms of Hks in Eq. < 15) and therefore we need 
only concern ourselves with : 


N 

-(plog(p) + q log(q))(J^(zi) - 1) + (7log(7) +plog(p))(l - zi) + (P log(/3) + qlog{q))(l - z N ) = N.H(f, N, a, 7 , /3, 5). 
2=1 

(16) 

Using Eq. ([7]), the expression of H(f,N,a,'y,/3,6) takes an easy form. To simplify the calculations, we restrict the 
space of parameter by assuming a + 7 = 1 and (3 + 5 = 1 and we parametrize the deviation from equilibrium by the 
parameter s = a — 5. Moreover let’s note a = jj. Thus, we have H(f , TV, a, 7, / 3 , S) = H(f, a, a , s). In order to know 
the Taylor expansion to the first order in s of f m ax KS we develop H(f, a, a, s) up to the second order in /; i.e. we 




FIG. 1. Entropy Production calculate usins; [III (left) and KS Entropy calculate usine[7land|15|(rie;ht) function of f for s = 0.13 
and respectively N = 20 N = 100 et N = 1000 
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have H(f, a,a,s ) = C + Bf + Af 2 + o(/ 2 ) then we find f ma x KS = —B/2A that we will develop in power of s. This 
is consistent if we assume / <C a. 

After some tedious but straightforward calculations, we get at the first order in s 




1 (1 — a) — a{a + 2) _ 

4 a(l — a) + 2aa(a — 1) ”*~ 


(17) 


and so, 


r - 1 - , 3a 

TmaxxsW- 4a s+ 4 ( a _ 1 ) 


s + o(s) + o(as). 


(18) 



/ / 





FIG. 2. Entropy Production (left) and KS Entropy (right) function of / for N = 1000 and respectively s = 0.13; s = 0.2; 
s = 0.04 



s 

FIG. 3. 2D plot representing A f rnax = fmax EP ~ fmax KS in the (N, s ) space. 



















We repeat the same procedure starting from Eq. (11) and we obtain: 


g 

fmaxEp(s) = "b o(s) + o(a). (19) 

Thus, since a = ^ <C 1 the behaviour of f m ax K s ( a ) and fmax BP (s) is the same for s small enough. 

We remark that we can strictly find the same result by solving the hydrodynamics continuous approximation given 
by Eq. ©■ This equation is a classical convection-diffusion equation. We remark that, by varying /, we change the 
convective behavior: / = 0 corresponds to a purely diffusive regime whereas by increasing / we enhance the role of 
convection. If the system is near equilibrium then f maXEP ~ fmax KS ~ 0 and the system is purely diffusive. When 
the system is out of equilibrium f ma x EP and fmax KS are different from 0 and corresponds to an (optimal) trade-off 
between purely diffusive and convective behavior. 

One can verify this numerically: We first calculate the exact values of the Entropy Production function of / using 
Eq. 0 and the Kolmogorov-Sinai Entropy function of / using Eqs. 0 ( |15| ). Then we approximate these two curves 
with a cubic spline approximation in order to find f ma x EP and f m ax KS • 




FIG. 4. f max EP (left) and fmax KS (right) function of s for a = 0.5 and N = 100. We remark than fmax KS and f ma x EP have 
both a linear behaviour with slope respectively 0.48 and 0.49 which is really close to jh = 0.5 




FIG. 5. We plot the slope of f m ax KS (s) (left) and f ma x EP (s) (right) function of a and in black the curve f(s) = j^s. We 
remark than the approximation f ma x KS (s) f» fmax EP (s ) «= is good 

In order to find the optimal resolution IV* we can go one step further by expanding fmax E p and fmax KS up to the 
second order in s: 


.(s) = 


s s 2 (ck + 1 ) 
4 a + 8a 2 (a — 1) 


+ o(s 2 ) + o(a). 


( 20 ) 
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; 0 ) 


1 (1 — a) — a(a + 2) _ (1 — a) 2 + a(a 2 — 2a + 1) _ 2 , 2 . 

4 a(l — a) + 2aa(a — 1) 8a 2 (a — 1) 2 (1 — 2a) 


( 21 ) 


Thus, fmax E p and f m ax KS coincide in second order in s iff a satisfies the quadratic equation: 

(4a — 6a 2 + 6a 3 — 4s + 3a 2 s)a 2 — ^(8a — 8s + 3a 2 s — 6a 2 + 6 a 3 )a — (1 — a) = 0. (22) 

This equation has a unique positive solution because the leading coefficient is positive for s small enough (4a — 6a 2 + 
6a 3 — 4s + 3a 2 s) > 0 and the constant term is negative —(1 — a) < 0. We remark that the optimal resolution iV* = 
depends on the parameters of the system namely on the degree of non-equilibrium. This fact can be the explanation 
for two well known issues in climate/weather modeling. First, it explains that, when downgrading or upgrading the 
resolution of convection models, the relevant parameters must be changed as they depend on the grid size. Second, it 
suggests that if the resolution is well tuned to represent a particular range of convective phenomena, it might fail in 
capturing the dynamics out of this range: since finer grids are needed to better represent deep convection phenomena, 
the deviations between model and observations observed in the distribution of extreme convective precipitation may 
be due to an inadequacy of the grid used. 


V. CONCLUSION 

We have shown how a simple ID Markov Process, the Zero Range Process, can be used to obtain rigorous results 
on the problem of parametrization of the passive scalar transport problem, relevant to many geophysical applications 
including temperature distribution in climate modeling. Using this model, we have derived rigorous results on the link 
between a principle of maximum entropy production and the principle of maximum Kolmogorov- Sinai entropy using 
a Markov model of the passive scalar diffusion called the Zero Range Process. The Kolmogorov-Sinai entropy seen as 
function of the convective velocity admit a unique maximum. We show analytically that both have the same Taylor 
expansion at the first order in the deviation from equilibrium. The behavior of these two maxima is explored as a 
function of the resolution N (equivalent to the number of boxes, in the box approximation). We found that for a fixed 
difference of potential between the reservoirs , the maximal convective velocity predicted by the maximum entropy 
production principle tends towards a non-zero value, while the maximum predicted using Kolmogorov-Sinai entropy 
tends to 0 when N goes to infinity. For values of N typical of those adopted by climatologists (TV ss 10 ~ 100), we 
show that the two maxima nevertheless coincide even far from equilibrium. Finally, we show that there is an optimal 
resolution iV* such that the two maxima coincide to second order in s, a parameter proportional to the non-equilibrium 
fluxes imposed to the boundaries. The fact that the optimal resolution depends on the intensity of the convective 
phenomena to be represented, points to new interesting research avenues, e.g. the introduction of convective models 
with adaptive grids optimized with maximum entropy principles on the basis of the convective phenomena to be 
represented. 

On another hand, the application of this principle to passive scalar transport parametrization is therefore expected to 
provide both the value of the optimal flux, and of the optimal number of degrees of freedom (resolution) to describe 
the system. It would be interesting to apply it to more realistic passive scalar transport problem, to see if it yield to 
model that can be numerically handled (i.e. corresponding to a number of bow that is small enough to be handled by 
present computers). In view of applications to atmospheric convection, it would be interesting to apply this procedure 
to the case of an active scalar, coupled with a Navier-Stokes equation for the velocity. In such a case, the role of / 
will be played by the turbulent subgrid Reynolds stresses. The heat fluxes and N* will be fixed by the coarse-graining 
length, and the optimization procedure will in principle provide the optimum subgrid Reynolds stresses at a given 
resolution N. Moreover, by imposing coincidence of MKS and MEP, one could get both the Reynolds stresses, heat 
fluxes and the optimum resolution. Moreover, on a theoretical side, it will be interesting to study whether for general 
dynamical systems, there exists a smart way to coarse grain the Kolmogorov- Sinai entropy such that its properties 
coincide with the thermodynamic entropy production. This will eventually justify the use of the MEP principle and 
explain the deviations as well as the different representations of it due to the dependence of the dynamic (Kolmogorov 
Smirnov, Tsallis, Jaynes) entropies on the kind of partition adopted. 


VI. APPENDIX: COMPUTATION OF THE K-S ENTROPY 


In this appendix, we compute the Kolmogorov-Sinai entropy for the Zero Range Process, starting from its definition 
Eq. (14). In the frame of our Zero Range Process , we use Eqs. (14) and ©> to write it as: 
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+oo +oo 

h K s = ~Y Pi ^ ^Pijlogipij) = - Y ■■■ Y P<pni 

i j mi—0 rriN—O j 

+oo +oo 

= - Y P ( mi )- Y P ( m N)Y P (™U---,rn N )^ 3 \°g{.P(m 1 ,...,m N )^j) ( 23 ) 

mi —0 rriN= 0 j 

We thus have to calculate YljP(m lt ...,mN)^j ^°s(P(m 1 ,...,m N )^j) that we will refer to as (*) . We will take p + q = 
a+<5 = / 3+7 = 1 and dt = in order to neglect the probabilities to stay in the same state compare to the probabilities 
of changing state. There are five different cases to consider: 

1 . if Vi m,; > 1 so the possible transitions are: 

(mi,m 2 ,..., mjv) —> (mi ± l,m 2 , ...,mjv) with respective probabilities a and <5 
(mi, m 2 , —> (mi, m 2 , ...,mN ± 1 ) with respective probabilities 7 and p 

and (mi,..., mfc,..., mjv) — > (mi,m^ ± 1 ,..., mjv) with respective probabilities p and q 

Thus, 


(*) = a log a + <5 log <5 +7 log 7 + piogP + (TV - l)(plog(p) + glog(g)) (24) 

2. if mi > 1 and mjv > 1 and let i be the number of m., between 2 and IV — 1 equal to 0. With the same argument 

as previously we have: 

(*) = aloga + <5log<5 + ylogy + /3log/3 + (TV - 1 - i)(p\og(p) + qlog(q)) (25) 

3. if mi = 0 and mpj > 1 and let i the number of m; between 2 and TV — 1 equal to 0 we have: 

(*) = a log a + S log S + p log ft + (TV — 2 — i)p log(p) + (TV — 1 — i)qlog(q) (26) 

4. The same applies if mi > 1 and m.v = 0 and let i the number of m^ between 2 and TV — 1 equal to 0 we have: 


(*) = aloga + S log 6 + 7 log 7 + (TV — 1 — i)p\og(p) + (TV — 2 — i)qlog(q) (27) 

5. finally, if mi = 0 and mjv = 0 and let i the number of m, between 2 and TV — 1 equal to 0 we have: 


(*) = aloga + dlogd + (TV - 2 - i)(p\og(p) + q\og(q) (28) 

Using equation [ 4 ] we find that P(mk = 0) = 1 — Zk and T p ( m k = i) = Zk 
We thus obtain than hxs writes: 

hxs = — (a log a + <5 log d + 7 log 7 + /T log ft + (TV - l)(p\og(p) + q\og(q)) 

N 

+ (plog(p) + qlog(q))(Yr Y II ( X “ Zi ) II 

r —0 i=ii,...i r 

+ (7l°g(7) +plog(p))2jv(l - zi)( y n _ o- -*o n 

22...^TV —1 

+ (P log (P) + q log q) Zi (1 - z N ) ( e n n 

+ (Plog(p) + 7 log 7 +plogp + glogg)( £ n.a-) n 2 *> < 29 ) 

-1 i=*2i-*r i^l2---i r 
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This expression, though complicated at first sight, can be simplified. Indeed interested in the function F(a) = 
IIi i z k + a(l — Zk)) and by deriving subject to a we show that: 

N N 

J2 r II a-**) II = ( 30 ) 

r=0 i\ ...in i=ii i =1 

Thus we can simplify the last equation and we obtain: 


h K s 


N 

—(<a log oi + S log <5 + 7 log 7 + /? log /? + (N - l)(plog(p) + r/log(g))) + (plog(p) + qlog(q)) ^(1 

i =1 


+ (7l°g(7) +pl°g(p))(l ~ z x ) + (/? log(/3) + glog(g))(l - z N ) 


( 31 ) 



